Title 

Method Of Using Multiple Populations With Cross-Breeding In A Genetic 
Algorithm 

Field of Invention 

The present invention relates generally to software methods for identifying 
optimal solutions to problems. More particularly, it relates to a genetic algorithm for 
combining solutions from various populations to identify optimal solutions. 

Background 

Various software methods are known for identifying optimal solutions to 
complicated problems. Some methods use genetic algorithms to identify various 
solutions. Genetic algorithms may be used to resolve any problem having parameters that 
define the scope of the problem and solution criteria used to judge the solution. Genetic 
algorithms may be used, for example, in an application for laying out an integrated 
circuit, where various layout solutions are possible. The algorithm may, for example, 
determine where components or cells of components should be positioned to achieve 
optimal utilization of chip area. 

Genetic algorithms start with one or more populations of potential solutions, also 
referred to as chromosomes or genes. The initial populations may be generated, for 
example, at random. Within the population, these solutions are compared with other 
solutions to create new solutions, hopefully resulting in better solutions. The process of 
combining solutions is referred to as "cross-over" or "cross-breeding" because the 
resulting "offspring" solutions have characteristics of one or more "parent" solutions used 
in cross-over. Cross-over creates a variety of solutions that may be more or less optimal 
than their parent solutions. Offspring solutions may also be created by other methods of 
modifying the solutions, referred to as "mutation." 

The offspring may be combined with the parent population, from which optimal 
solutions may be identified during a process of "competition," also referred to as 
"selection." Selection may simply remove less optimal solutions from the population. 
An example method may include several iterations of cross-over and selection, such that 
several generations of solutions are generated for the population. During this example 
process, mutations may occur to introduce more beneficial traits into the population. In 
one example, multiple populations may separately use this same process to create 
multiple solutions. 

In existing methods, the offspring within a population tend to look very similar. 
The process of intra-population is overly degenerative, thereby causing a lack of diversity 
in the resulting solutions. Because of this lack of diversity, the solution generated by a 
population tends to be optimal only with respect to similar solutions and may not be 
optimal when considered in context of the entire problem. Mutation may provide some 
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diversity, but does not solve the problem. Another method of creating diversity is to 
retain less optimal solutions during the process of competition. The problem with this 
method is that it keeps potentially bad solutions in the population and still results in less 
optimal solutions. What is needed is an improved genetic algorithm for identifying 
optimal solutions. In particular, what is needed is a method for introducing greater 
diversity into a genetic algorithm. 

Summary of Invention 
A method is disclosed for processing data to identify optimal solutions to a 
problem using a genetic algorithm. Multiple data populations are created and kept 
separate from each other. Each population has multiple data entries, referred to as 
solutions. The initial solutions in the population may be selected at random, based on 
input parameters related to a problem. Solutions are rated based on their desirability. 
Solutions from one population are combined, or "cross-bred," with solutions from 
another population to create offspring solutions. The offspring of the cross-over are 
associated with one of the parent populations and rated. A selection process then selects 
the most desirable solutions as determined by criteria within a population from the parent 
and offspring solutions to form the next generation of solutions. The remaining solutions 
may be discarded from the population. The cross-over and selection steps may then be 
repeated to cross-over second-generation solutions to create a third generation. Other 
known methods may also be applied during the process, such as mutation steps and intra- 
population breeding, as desired. The method may be implemented, for example, to 
design the layout of a circuit board. Diversity of solutions is increased by keeping the 
populations separate but allowing cross-breeding. 

A system and tangible computer-readable medium are also disclosed for 
processing data to identify optimal solutions, given input parameters and preferred output 
characteristics. The system and medium include a memory that stores data and 
executable instructions that process the data using a method. The data includes multiple 
separate populations of solutions. The method combines solutions from one population 
with solutions from another population during a cross-over step performed in a 
conventional manner. The cross-over produces offspring solutions from the parent 
solutions from the different populations. The offspring solutions are associated with at 
least one of the parent populations. A selection process occurs within each population to 
select the most desirable solutions from the parents and offspring to form the next 
generation of solutions. The remaining solutions may be discarded from the population. 
The next generation of solutions from one population may then be crossed with solutions 
from another population to create a second generation of offspring associated with one of 
the populations. Another selection process may then select the most desirable solutions 
to comprise the third generation. 
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Summary of Drawings 

Figure 1 shows a flow chart of the method. 

Figure 2 shows a block diagram of a system that uses the method. 
Figure 3 shows a block diagram of a system that uses the method. 
5 Figure 4 shows a more detailed flow chart of the method of Figure 1 

Figure 5 shows a block diagram of a computer system that uses the method. 

Detailed Description 
Figure 1 shows a flow chart of the method 100. Populations of solutions are 
created 110. As used herein, solutions include any entry or item of data in a population. 
10 Solutions may also be referred to as chromosomes. The current generation of solutions in 

the populations may evolve from one generation to the next using the method 100. 
Solutions from one population (the first generation or parent generation) are cross-bred 
120 with first- generation solutions from another population using known cross-over 
Q methods. As used herein, the terms "combine," "cross-over," "cross-breed," and "cross" 

*|5 refer to any method of combining attributes from two or more solutions to create another 

Q solution, and may include, for example, any known genetic algorithms for combining 

^| solutions. The offspring created by the cross-over 120 are grouped with the population of 

- one of the parents. The next generation of solutions for that population is selected 130 

4= from solutions that comprise the parent generation and the offspring. One skilled in the 

fZO art will recognize that the offspring may be selected 130 according to any desired 

,=! 4 characteristics. In one embodiment, a specified number of the highest-scored solutions 

;~ may be selected 130. In another embodiment, a number of solutions may be selected at 

p random. In still another embodiment, a combination of the highest-scored solutions and 

^ lower-scored solutions may be used to create diversity. The parent generation and the 

25 offspring for each population may then be discarded, or they may be stored, as desired. 

The process 100 may then repeat the cross-over 120 and selection 130 steps using 
the second generations of various populations, and this cross-over-selection-repeat 
process may continue for numerous iterations. For example, in the second application of 
the cross-over 120 and selection 130 steps, the second generation solutions from separate 
30 populations are cross-bred 120 and third generation solutions are selected 130 within each 

population using a selection process that chooses among second-generation solutions and 
offspring solutions from the cross-over 120 of second generation solutions. 

Figure 2 shows a block diagram of a system on which the method 100 may be 
applied. Figure 2 illustrates the application of the cross-over step 120 of the method 100. 
35 The system has multiple populations 10 that are cross-bred 120 by the method 100. Any 

number of populations 10 may be used and are shown as "Population #1, Population #2, 
. . . Population #N." Each population 10 has a current generation 20 of solutions 22. A 
generation 20 may have any number of solutions 22, which are shown as "Solution #1, 
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Solution #2 ... Solution #M." In the example of Figure 2, the current generations 20 are 
referred to as the "First Generations," although the current generations 20 may or may not 
be the first generations to which the method 100 is applied, for example, because the 
cross-over and selection steps 120, 130 of the method 100 may repeat. 
5 Solutions 22 from first generations 20 in separate populations 1 0 are combined in 

a cross-over process 120 that "breeds" the solutions to produce an "offspring" solution 
32. In the example of Figure 2, Solution #2 from Population #1 is shown to be crossed 
with Solution #3 from Population #2. One skilled in the art will recognize that cross-over 
120 step of the method 100 may be applied between any solution 22 in a particular 

10 population 10 and any particular solution 22 in another population 10. A single solution 

22 may be crossed with multiple solutions 22 from another population 10 to create 
multiple offspring solutions 32 having a single parent. Also, solutions 22 from one 
population 10 may be crossed with solutions 22 from multiple other populations 10. The 
offspring solutions 32 are referred to collectively as the offspring 30. In one 

15 embodiment, such as that shown in Figure 2, solutions 22 may be crossed 120 only 

2 between two populations 10, each first generation solution 22 may be crossed only once, 

and the offspring solutions 32 may number the same as the parent solutions 22, for 
example, 1-N for each. The offspring 30 are associated with one of the parent 
generations 20 and kept within the same population 10. 

20 Figure 3 shows a block diagram of a system that illustrates the application of the 

selection step 130 of the method 100. Within each population 10, solutions 22 from the 
first (parent) generation 20 are compared 130 with solutions 32 from the offspring 30 
associated with the population 10. A second generation 40 of solutions 42 is selected 130 
from the parent generation solutions 22 and the offspring-solutions 32 from the parent 

25 cross-over 120. The cross-over 120 and selection 130 steps may then be repeated to 

cross-over the second generation 40 with a second generation 40 from another population 
10 or with any other set of solutions. The offspring and previous generations 30, 20 may 
be discarded after the selection process 130, or they may be saved. 

Figure 4 shows a more detailed flow chart of the method 100 of Figure 1. 

30 Separate populations 10 of solutions 22 are created 1 10 by determining 1 12 whether a 

desired number of populations 10 have been created, and determining 1 14 whether a 
desired number of solutions 22 have been created for each population 10. Until the 
population creation process 1 10 is completed, a solution 22 is created 1 16 within the 
population 10. The solution 22 may be created, for example, at random. Each solution 

35 22 is rated 1 1 8, or scored 118, based on its result, according to defined criteria. More 

optimal solutions will have scores that reflect that fact. 

After the populations 1 0 have been created 1 1 0, the solutions 22 are cross-bred 
120 combining solutions 22 from one population 10 with solutions 22 from another 
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population 1 0. In one embodiment, the solutions 22 are kept separate until except during 
cross-over 120. The method 100 determines 121 whether all of the offspring solutions 32 
have been created. Until each solution 22 is processed 121, a first population 10 and 
solution 22 within that first population are selected 122, 123. A second population 10 
5 and solution 22 within that second population 1 0 are then selected 124, 125 to cross- 

breed with the solution 22 from the first population 10. The solutions 22 are combined 
126 to create an offspring solution 32, which is then added 127 to the first population 10. 
As part of the cross-over process 120 the offspring solutions are scored based on their 
desirability. As used herein, a "score" refers to any measure of the desirability of a 
10 solution 22. The cross-bred solutions 22 may be referred to as the parents or the previous 

generation of solutions. Offspring may be scored based on any criteria defined by the 
user. In one embodiment, the offspring is associated with the first population 10 but is 
maintained separately. In an alternative embodiment, offspring are stored in a single data 
Q file along with parent solutions 22 from the same population 10. 

15 In one embodiment, each solution 22 from the first population 10 may be crossed 

q s with a solution 22 from the same second population 10. In other embodiments, the 

'2 solutions 22 from the first population 10 may be combined with solutions 22 from various 

i other populations 10. The solutions 22 that are combined during cross-over 120 may be 

HF selected 122, 123, 124, 125 in a pre-defined manner, or randomly. For example, in one 

j^0 embodiment the first solution 22 in the first population 10 may be combined with the first 

Sj solution 22 in the second population 1 0, the second solution 22 from the first population 

10 may be combined with the second solution 22 in the second population 10, etc. In 
q another embodiment, the solutions 22 may be combined randomly. Each solution 22 in 

H* the first population 10 may be combined with different solutions 22 from other 

25 populations 1 0, or the same solution 22 from the other population 1 0 may be combined 

with more than one solution 22 from the first population 10. In one embodiment, each 
solution 22 in the first population 10 may not be combined during cross-over 120, while 
in other embodiments each solution 22 in the first population 10 is cross-bred 120. In one 
embodiment, each solution 22 in the first population 10 generates one offspring 32, while 
30 in other embodiments, the total number of offspring 32 may be different than the number 

of parent solutions 22 in the first population 1 0. 

After the cross-over 120, the selection process 130 occurs to identify the more 
optimal solutions. The selection process 130 occurs until each solution 22, 32 in the 
population 10 is processed. For each solution, the selection process 130 selects 134 a 
35 next-generation solution 42 based on the solutions' scores. The selection process 130 

may apply to both the parent solutions 22 and the offspring 32. The selected solutions 42 
may be referred to as the next generation, or the second generation in the example of 
Figure 4. The second generation 40 may include solutions 42 from both the parents and 
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their offspring, depending upon the selection process. In one embodiment, the selection 
process 130 may require a particular score in order to be selected. In another 
embodiment, the selection process 130 may select a predetermined number of solutions 
for each population - for example, the most desirable 50 scores for each population. The 
non-selected solutions 22, 32 may be discarded, if desired. The cross-over 120 and 
selection 130 processes may be repeated as desired, such that the second generation 
solutions are then crossed with solutions from other populations 10. In one embodiment, 
second-generation solutions 42 from a first population 1 0 are crossed with second- 
generation solutions 42 from a second population 10. 

In the embodiment of Figure 4, a mutation step 140 is shown to illustrate that the 
method 100 may be implemented to include known genetic algorithms. Each population 
10 and each solution within each population may be processed 142, 144 separately. For 
each solution, the mutation step 140 mutates 146 using known methods of mutation. The 
mutation step 140 may introduce a particular characteristic to the solutions. In the 
example of Figure 4, the cross-over, selection, and mutation steps 120, 130, 140 are then 
repeated as desired. 

By way of example, the method 100 and system may be implemented to design 
the layout of an integrated circuit chip. The chip design may comprise numerous 
interconnected hierarchical cells capable of being positioned in various locations on the 
chip. The method 100 may be used to identify the most efficient layout of those cells. 
The layout of the cells may have certain rules, for example, rules that prevent multiple 
cells from occupying the same place on the chip. The layout may have certain desired 
characteristics such as timing between certain cells, overall length of transmission lines 
connecting cells, proximity between cells, overall area consumed by the design, etc. The 
score or rating of a particular design may reflect how well the design comports with the 
desired characteristics. 

Multiple separate populations 10 may be created 1 10, each population 10 
comprising multiple data entries 22, each of which represents a possible layout solution 
22. Initially, the layout solutions 22 may be selected randomly, or through any other 
method. The group of initial parent layout solutions 22 for each population 10 may be 
referred to as the first generation 20. One layout solution 22 from a first population 10 
may then be combined 120 with a layout solution 22 from another population 10 to 
create an offspring layout solution 32. This offspring solution 32 is then associated with 
at least one of the parent populations 10. The group of offspring solutions 32 is referred 
to generally as the offspring 30. Each parent solution 22 and offspring solution 32 has a 
score. When the cross-over process 120 is complete, all of the layout solutions 22, 32 
within each population 1 0 - the offspring 32 and parent solutions 22 - are compared 
during a selection, or competition, process 130. The most desirable solutions for each 
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population 10 - those having the best scores - are retained in the population 10 and the 
less desirable solutions 22, 32 are discarded. This process of cross-over 120 and selection 
130 repeats itself through many iterations until an optimal solution is discovered. During 
this process, known genetic methods such as mutation or intra-population breeding may 
5 be employed as desired. 

Figure 5 shows a block diagram of a computer system 400 having a processor 410 
connected to an input device 420 and a display device 430. The processor 410 accesses 
memory 440 in the computer system 400 that stores populations 10 of solutions 22. The 
memory 440 also stores a software application having instructions that apply the method 
10 100. In use, the input device 420 receives commands instructing the processor 410 to call 

the software algorithm 100 to perform cross-over, selection, and other steps 120, 130 of 
the method 100. The results of the method 100, such as the second-generation solutions 
42, may be displayed on the display device 430. 
Q Although the present invention has been described with respect to particular 

5 *f 5 embodiments thereof, variations are possible. The present invention may be embodied in 

q specific forms without departing from the essential spirit or attributes thereof. Although 

2 the invention is described as being implemented in connection with a circuit design 

13 layout, one skilled in the art will recognize that the method and system may be employed 

4= in connection with any application where a genetic algorithm may be helpful. One 

~g2f) skilled in the art will recognize that such applications include by way of example, but are 

• J not limited to, the optimization of manufacturing flow scheduling, Boolean logic 

°~ synthesis, printed circuit board routing and integrated circuit routing, optimization of fuel 

□ consumption for rail transportation, petroleum production optimization, traffic routing in 

^* a telecommunications network, optimization of publication layouts, image classification, 

25 handwriting recognition, and routing and scheduling for buses, public transportation, 

delivery services, etc. In addition, although aspects of an implementation consistent with 
the present invention are described as being stored in memory, one skilled in the art will 
appreciate that these aspects can also be stored on or read from other types of computer 
program products or computer-readable media, such as secondary storage devices, 
30 including hard disks, floppy disks, or CD-ROM; a carrier wave from the Internet or other 
network; or other forms of RAM or read-only memory (ROM). It is desired that the 
embodiments described herein be considered in all respects illustrative and not restrictive 
and that reference be made to the appended claims and their equivalents for determining 
the scope of the invention. 

35 
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